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ABSTRACT 

This  thesis  is  an  accuracy  study  of  three  empirical 
series  system  lower  confidence  limit  procedures.  Computer 
simulations  were  used  to  compare  the  accuracy  of  the  pro- 
cedures using  the  same  set  of  data  with  500  replications 
for  each  case.  Modifications  were  then  made  to  improve  the 
accuracy  of  the  Log-Gamma  method. 

The  systems  simulated  had  reliabilities  ranging  from  .6 
to  .95.   They  were  composed  of  four,  fifteen,  or  forty  com- 
ponents, and  had  component  sample  sizes  of  ten,  twenty,  or 
fifty. 

The  Lieberman-Ross  method  was  accurate  but  had  high 
variance.  The  Log-Gamma  method  was  conservative  with  small 
sample  sizes,  but  became  more  accurate  with  increased  test- 
ing.  Randomization  of  the  Log-Gamma  method  was  the  most 
successful  of  the  modifications  attempted. 
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I.   INTRODUCTION 

There  exist  many  lower  confidence  limit  procedures  for 
series  system  reliability  which  are  based  on  component  data. 
All  of  them  are  approximate  in  one  way  or  another  for  real- 
istic testing  situations.   Two  such  procedures  are  the 
Lie#berman-Ross  (LR)  procedure  and  the  Log-Gamma  (LG)  proce- 
dure.  The  LR  lower  confidence  limit  (LCL)  is  based  on 
operating  time  data  and  assumes  time  to  failure  is  expo- 
nentially distributed.   The  LG  LCL  is  based  on  attributes 
data  and  thus  is  non-parametric.   A  modification  of  the  LG 
procedure,  called  the  Continuous  Log-Gamma  (CLG)  procedure, 
is  based  on  time  data  and  assumes  an  exponential  failure 
distribution. 

In  this  thesis  the  accuracy  of  the  LR,  LG,  and  CLG  pro- 
cedures are  compared  when  data  is  generated  from  the  expo- 
nential distribution  for  serial  systems  with  four,  fifteen, 
and  forty  components.   Sample  sizes  are  generated  in  a 
manner  which  is  somewhat  representative  of  data  accumulated 
from  missile  flight  tests. 

The  accuracy  analysis  was  extended  to  the  case  where 
all  components  were  assumed  to  have  a  Weibull  distribution 
with  increasing  and  decreasing  failure  rates. 

In  all  cases,  the  LR  and  LG  procedures  were  slightly 
modified  from  their  more  common  forms  in  order  to  accommodate 
zero  failures  on  all  components. 


Since  the  component  test  data  was  generated  using  the 
exponential  assumption,  the  LR  method  enjoyed  an  advantage 
over  the  LG  method  in  that  continuous  LCL  procedures  are 
exact  while  discrete  LCL  procedures  are  not.   All  discrete 
100(l-a)#  LCL's,  Rs  L(a\#  for  system  reliability  Rs  have 
the  property  that 

p[*S.L(a)  ^Rsl  i1-* 

For  some  values  of  R_,  this  probability  is  100#.   Thus  dis- 

s 

crete  LCL's  will  usually  be  lower  in  value  than  a  continu- 
ous LCL  using  the  same  set  of  data.   Discrete  LCL's  have 
the  advantage,  however,  of  remaining  the  same  regardless 
of  the  underlying  distribution.   Consequently,  they  are 
not  susceptible  to  inaccuracies  due  to  a  mistaken  assump- 
tion about  the  probability  distribution  of  the  operating 
component  time  data  as  are  continuous  procedures.   That  is, 
if  R«  T/a)  is  discrete 

p^S,L(a)  i"^1-1 

regardless  of  the  probability  distribution  of  the  component 
time  data,  whereas  if  R«  r(a)    is  continuous 

provided  the  required  assumption  made  about  the  probability 
distribution  of  the  component  failure  data  is  correct. 
Even  if  the  assumed  continuous  distribution  is  not  correct, 
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however,  Rg  T/a)  may  still  be  reasonably  accurate,  depend- 
ing upon  the  true  component  failure  distribution.   Of  course 
these  distributions  are  never  known. 

Finally,  continuous  LCL's  required  more  refined  data 
than  discrete  LCL's.  Discrete  LCL  procedures  can  be  used 
if  continuous  time  data  is  available  but  continuous  LCL 
procedures  cannot  be  employed  with  only  attributes  data. 
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II.   DESCRIPTION  OF  THE  METHODS 

A.   THE  LOG-GAMMA  METHOD 

The  following  development  is  a  summary  of  that  given 
in  Ref,  1.   The  Log-Gamma  (LG)  method  requires  only  attri- 
butes data,  and  assumes  nothing  about  the  failure  distribu- 
tion.  It  is  designed  for  independent  series  systems,  does 
not  require  equal  component  sample  sizes,  and  is  approxi- 
mate.  A  modification  of  the  LG  method  for  systems  composed 
of  a  mixture  of  series  and  parallel-connected  components 
was  explored  by  Ref.  2. 

Suppose  a  system  consists  of  K  components  in  series, 
and  that  N.  copies  of  component  i  are  put  on  test  and  oper- 
ated until  failure  or  completion  of  mission,  whichever 
occurs  first.   Denote  F.  as  the  number  of  components  of 
type  i  that  did  not  complete  the  mission.   Then  the  maximum 
likelihood  estimate  for  system  reliability  is 

rs=  ir  r«  (2.1) 

s  i=l  1 

Ni'Fi  ,       i 

where         Ri  = —  N<  (2.2) 

In  the  LG  procedure  the  method  of  moments  is  used  to 
fit  the  random  variable  -InR  with  the  two-parameter  gamma 
distribution.   The  gamma  is  then  transformed  into  a  chi 
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square  distribution,  about  which  probability  statements 
are  made  and  a  lower  confidence  limit  (LCL)  obtained. 
That  is,  define 


K         K 
S  =  -lnR„  =  -In fT  R.  =  -  L  ln(l-Q.)  (2.3) 

i=l  x    i=l      1 


s 


K 


K 


*  I  (Q. -»■  JQJ)  SET, 
i=l   1    1   i=l  x 


An  unbiased  estimator  T.  for  T,  is 

A2 

of 

Ti=AxQi  +  Bi-r 


(See  Appendix  A) 
(2. if) 


(2.5) 


2N.-3 
where   A.  =  2N.  _2 


(2.6) 


N« 

Bi  =  N4  -1 


(2.7) 


and 


Fi 

Qi  =  nT 


i  =  l  ,  K 


(See  Appendix  B) 


That  T.  is  unbiased  is  important,  because 
K 


A        «■    A 

S  =  Z    T. 
1=1  1 


(2.8) 


is  used  as  an  estimator  for  S,  thereby  accumulating  any 

A 

bias  present  in  the  T..   An  approximate  value  for  the  vari- 


ance of  S  is 


K 


Var(S)  =  Z    Var(T, ) 
i=l      1 


K   T. 
1=1  Ni 


(2.9) 


13 


A 

Appendix  C  derives  the  actual  variance  of  T.  and  shows 

A 

equation  (2.9)  is  an  excellent  approximation  for  Var(S), 

A 

Next,  fit  S  with  a  gamma  distribution.   The  probability 

A 

distribution  of  S  is  then  given  by  the  density  function 
fg(x;r,e)= F"x  "  ExP(-x/0)    x>0,r>0      (2.10) 

r(r)e  e>o 


It  follows  that 


E(S)  =  re  (2.11) 

Var(S)  =  re2  (2.12) 


A 

Since  S  is  unbiased, 


E(S)  =  S 

K 

=  I  T,  (2.13) 

i=l  X 

Solving  equations  (2.9),  (2.11),  (2.12),  and  (2.13) 
simultaneously  gives  the  shape  parameter 

/K       \2  /K    T. 
and  the   scale  parameter 

•-(j^yjL'i         (2-i5) 

Thus,  r  can  be  estimated  by 

K    A  \2  /  K    T. 
*   Sf  ^Jij/irf  (2>16) 


Ik 


Since  S  is  distributed  gamma   (r,6),   — g-  is  distributed  ^2     . 
Then 


A 


1 


2S   ^  n/2 


-«-p<-^2^.«.2r)  (2'17) 


■2 


A 


=  P(2rS>re  •l1.af2r) 

Since  S  is  unbiased 
E(S)  =  S 
=  re 


=  -lnR_  (2*.18) 
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Equation  (2.1?)  becomes 


l-o  =  P(2rS>-lnRs.^-a>2r) 

=  P(ExJ     "2rS      1<RS)  (2.19) 

l>ll-af2rj 

Therefore,   the  LG  100(l-a)#  LCL  for  system  reliability  R 

s 

is 

To  preclude  usage  of  non-integer  degrees  of  freedom,  the 
approximation 

72  ^\  (2.21) 

Al-a, [2r] 

is  used  in  equation  (2.20),  where  [2r]  denotes  the  smallest 
integer  greater  than  or  equal  to  2r.   Approximation  (2.21) 
was  shown  to  have  little  effect  on  the  LG  procedure  accur- 
acy [Ref .  2,  p.  13J .   However,  it  may  produce  monotonicity 
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problems  under  certain  circumstances  (discussed  in  Chapter 
V),   Thus,  the  100(l-a)#  LCL  becomes 

and  was  the  LG  LCL  initially  simulated  by  this  study  (Chap- 
ter IV). 

B.   THE  CONTINUOUS  LOG-GAMMA  METHOD 

The  Continuous  Log-Gamma  (CLG)  method  is  developed  in 
detail  by  Ref.  3,  pages  C-l  through  C-20  (as  the  "Classi- 
cal" method).   It  differs  from  the  LG  method  only  in  that 
it  requires  component  time  data  and  assumes  exponential 
failures. 

The  derivation  of  the  CLG  procedure  is  analogous  to 

that  of  the  LG  procedure,  and  is  outlined  as  follows. 

Define 

Z  s  -lnRs 

(2.23) 


=  -In  ft  R< 
i=l  x 


Using  time  data  and  assuming  exponentiality,  R.  can  be  esti' 
mated  by 

"i-^-dsq-5      i=1'K 

where  Tsum.  is  the  accumulated  operating  time  of  the  ith 

component.   Then  Z  is  estimated  by 

a    K  p, 

Z  =  L   — L- (2.2*0 

^_^  Tsum. 
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A 

The  method  of  moments  gamma  fit  to  Z  uses 

K   F. 

V^M    '   j^Tiy/Ni  <2'26> 

E(Z)  =  LX  (2.27) 

and        Var(Z)  =  L\2  (2.28) 

where  L  is  the  shape  parameter  and  \   is  the  scale  parameter. 
The  resultant  CLG  100(l-a)#  LCL  is 


A  A 
A 


RS.L(a)  =  **>&P*i)  (2'29) 


\Y2 
M-a, 


2L 


with 


(2.30) 


To  preclude  non-integer  degrees  of  freedom 


where  [2LJ  is  the  smallest  integer  greater  than  or  equal 

A 

to  2L. 

C.   THE  LIEBERMAN-ROSS  METHOD 
1.   The  Original  Procedure 

The  Lieberman-Ross  (LR)  method  was  designed  as  an 
exact  lower  confidence  limit  (LCL)  procedure  for  independ- 
ent series  systems  (see  Ref.  *0.   It  requires  component 
times  between  successive  failures  from  an  assigned  exponen- 
tial failure  distribution,  and  does  not  require  equal  com- 
ponent sample  sizes. 
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The  test  plan  may  be  described  as  follows.   Suppose 
N.  copies  of  each  component  type  i  are  available  for  testing, 
Place  a  copy  of  the  ith  component  on  test,  and  replace  it 
when  it  fails.   Continue  testing  with  replacement  until  all 
available  copies  of  one  component  are  exhausted  (this  proce- 
dure need  not  be  conducted  simultaneously  for  all  component 
types).   For  the  ith  component,  denote  the  time  to  the  first 
failure  as  T.-,  between  the  first  and  second  failure  as  T-2, 
and  so  forth.   In  general,  the  time  between  the  jth  and 
(j-l)th  failure  on  the  ith  component  is  T.  .,   i  =  l,....,K 

j  =  1 .N. 

where  the  T. .  are  in  mission  units.   Reference  4,  p.  8^0, 
also  describes  the  LR  procedure  for  Type  II  censoring  at 
the  rth  failure  of  R  items  on  simultaneous  test.   Reference 
3»  p»  C-32,  illustrates  the  procedure  using  component  times 
between  successive  failures  and  the  observed  success  time 
of  the  last  copy  of  each  type  tested. 

The  LR  LCL  is  computed  as  follows.   Define 

Let  I.  be  the  greatest  index  such  that 

i 


•L  Tij-  U      i  =  1 ,K'  (2,33) 


Also  define      K 

I  5  Z  I,  (2.3*0 

1=1  x 
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The  variable  I  is  the  total  number  of  failures  in  all  com- 
ponents up  to  and  including  U  (see  Figure  1).   Then  the  LR 


lOO(l-a)^  LCL  for  system  reliability  R_  is  given  by 

5 


72 
RS,L(a)  "Exp(   2U 


(2.35) 


Figure  1 

Depiction  of  Lieberman-Ross  Parameters 
U=35  and  1=6,  when  K=2,  N^,  and  N2=3 


COMPONENT 
i=2,N2=3 


■*- 


■*■ 


i 
i 

i 


5    10   15   20   25   30   35   ^o 

U  Time 

To  implement  the  LR  procedure,  the  component  data 
order  must  be  specified.   If  only  a  set  of  component  data 
were  available,  then  a  different  procedure  would  have  to  be 
used.   Note  that  the  opposite  chi  square  tail  is  used  from 
that  of  the  LG  and  CLG  methods. 

2.   The  Modified  Lieberman-Ross  Method 

The  original  procedure  utilizes  accumulated  compo- 
nent times  between  failures.   The  Modified  Lieberman-Ross 
procedure  (MLR),  uses  instead  component  times  to  one  mission 
unit  or  failure,  whichever  occurs  first.   The  MLR  method  is 
thereby  more  readily  applied  than  the  LR  method  to  actual 
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system  test  data,  especially  when  testing  is  destructive 
(for  example,  a  missile  firing).   The  MLR  method  also  can 
be  used  when  no  failures  occur,  whereas  the  LR  method  could 
not  (see  Appendix  D). 

The  MLR  procedure  is 

a.   Suppose  N.  copies  of  the  ith  component  are  avail- 
able for  testing.   Define  T. .  as  for  the  LR  procedure,  ex- 
cept  all  times  past  one  mission  unit  are  truncated  to  one. 
Next,  define 

*    il  where  i^  is  the  index  of 

T.-  =  Z    T.  .       the  first  component  time      ,~   ^x 
11   o=l  1J       less  than  one  mission         u,JOJ 

unit  for  the  ith  component 


*    ig  where  i?  is  the  index  of 

T«2=  L    Tj_j    the  second  component  time     /2  ^\ 
1   j=i^+l       less  than  one  mission  unit      '*" 

for  the  ith  component 


•  where  if-    is  the  index  of 

*      ip.       the  last  component  time 
iFi  =    Z1     T.  .   less  than  one  mission  unit     (2.38) 


?i    for  the  ith  component 


Then  obtain 

T%  £  T?,       i  =  l ,K  (2.39) 

1   j=l  1J 

b.   Compute  the  minimum  accumulated  times  between 
successive  failures  in  any  component  type. 

K 


U   = 


ri<i^TI  ifi=lFi>°  ^^^ 

K 
ll<i<KNi  if     L    Fi=°  (see  APPendix  D) 
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The  variable  I.  is  now  defined  in  terms  of  the  T.. 


h  = 


Then 


the  greatest  index  such  that 


1i    * 

I  T. .  <  U 

-1  1J 


0=1 
0 


K 


I=max<l,  I  I. 


if  Fi>0 


if  Fi  =  0 


(2.M) 


(2.^2) 


c.   Now  the  MLR  100(l-<x)#  LCL  for  R_  can  be 


computed 


RS,L(a)=ExPi% 
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(2.^3) 


Like  the  LR  method,  the  component  data  order  must  be 
specified. 
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III.   THE  SIMULATION 

A.   GENERAL  METHODOLOGY 

Any  lower  confidence  limit  (LCL)  procedure  can  be  evalu- 
ated by  computer  simulation  of  its  distribution  as  follows: 

1.   Suppose  it  is  desired  to  evaluate  a  proposed 

A 

100(l-a)>  LCL  procedure,  denoted  Rs  T(aw  for  system  relia- 
bility R  .   Then  the  assertion  is 
s 


f-A 

PlRS,L(a)-RS 


>  1  -a  (3-D 


Equality  should  hold  if  Rs  rf-)    is  a  continuous  random 
variable. 

2.  R  =f(R-,R2, Rv^'  where  Ri  ^s  "tJie  "true  reliabil- 
ity of  the  ith  component.   For  an  independent  series  system, 

K 
Ra  =  Tf  ^i  •  If  exponentiality  is  assumed,  an  equivalent 
i=l 

statement  is  R  =  f  (X^Xpt .  • . .  »X,  ) . 

3.  Assign  values  to  the  parameters  a,  K,  and  R.  (or  X».), 
i = 1, 2, . . , . ,K.   Simulate  life  testing  by  generating  random 
component  times -to-failure,  and  compute  the  resultant 

A 

RS,L(a)  ' 

A 

k9     Generate  the  approximate  distribution  of  Rs  T(a) 
by  repeating  step  3  five  hundred  times. 

A  A 

5.   Order  the  Rc  T /  n  realizations  to  get  RQ  T/  *    ,... 
S,L(a)(500)  ' 
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6.  Find  the  (l-a)500th  order  statistic  of  Rs  w  )  and 
denote  it  A-   .  Thus  A-    is  the  (l-a)th  percentile  of 

A 

the  distribution  of  the  LCL  random  variable  R0  T /„  \ .   If 

in  fact,  Rg  ./  )  is  an  exact  100(l-a)#  LCL  procedure  for 

R_,  then  A1    should  be  approximately  equal  to  R  . 
s        ■L~ct  s 

7.  By  repeating  steps  3  through  6  for  various  sets  of 
K,NltN2, , . . .  ,N,,  R-^Rp, . . . .  ,R,  and  a,  and  comparing  the 
resultant  A-    to  R_,  the  overall  performance  of  the  LCL 
procedure  can  be  evaluated. 

A 

The  actual  confidence  level  given  by  R~  ^  /  \    can  be  ob- 
tained by  finding  the  order  statistic  of  the  generated 
distribution  which  matches  (or  closest  matches)  R  .   If 

the  index  of  this  order  statistic  is  denoted  i  ,  then 

♦*  A 

(I00jt)«=4s  =  Actual  Level  of  Confidence  of  Rg  L,  s  (3.2) 

Equivalently,  if  A-   <Ra#  the  procedure  is  a  conservative 

i-a   s 

one,  and  vice-versa. 

Figure  2  depicts  a  conservative  outcome  with  A.   ^g* 
The  degree  to  which  A-    equals  R  reflects  the  validity 

A 

of  equation  (3«1)  and  therefore  the  accuracy  of  R~  L /  v. 

Figure  2 


f  A 


S,L(a) 
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Not  only  should  an  LCL  procedure  be  accurate,  but  also 

A 

should  have  small  standard  deviation.   Even  though  Rs  r/a\ 
may  be  an  exact  LCL  procedure,  its  practical  value  is 
diminished  if  it  produces  widely  dispersed  LCL*s.   This 
study  used  both  criteria  for  comparison  of  the  three  methods. 

B.   GENERATION  OF  SAMPLE  SIZES 

The  component  test  data  are  generated  in  a  manner  some- 
what representative  of  data  accumulated  in  missile  flight 
tests.   Suppose  some  number  of  series  systems  are  to  be 
used  for  testing.   Failure  of  a  component  may  fail  the  sys- 
tem, but  still  allow  testing  on  components  upstream  of  the 
failed  one.   For  example,  if  the  system  is  a  five-stage 
missile,  failure  of  the  third  stage  may  or  may  not  allow 
testing  on  stages  four  and  five. 

Input  parameter  N-,  the  number  of  mission  tests  on  the 
first  component,  is  the  number  of  systems  to  be  tested.   A 
component  failure  is  assumed  to  preclude  testing  on  upstream 
components  one-half  the  time.   The  simulation  computes  the 
number  of  tests  on  the  ith  component  as 

r  i-i 

z 
I   3*1 

where  "|_  J"  denotes  "the  smallest  integer  greater  than  or 
equal  to1*.   To  illustrate,  let  N-=20  and  assume  the  first 
component  had  three  failures.   Then  the  component  two 
sample  size  becomes 


ft  L  Pj 


(3.3) 


N2  =  20  - 


1(3) 


=  18  mission  trials 


Zh 


It  should  "be  understood,  however,  that  the  three  procedures 
themselves  do  not  require  this  scheme,  but  are  valid  for 
varying  sample  sizes. 

C.   THE  SIMULATION  ALGORITHM 

Step  onet   Initilize  the  number  of  series  components  K, 
the  number  of  systems  to  be  tested  N.  ,  the  true  reliability 
of  the  ith  component  R.,  i=l,2,..,,K,  and  the  number  of 
replications  desired  ("Do  Loop"  index). 

Step  two i   Using  the  probability  integral  transform 
(PIT)  method  |_Ref.  5i  P«  I68j  ,  generate  exponential  failure 
times  for  the  N«  copies  of  the  first  component  as  shown 
below.   Exponential  failure  data  is  a  requirement  for  the 
CLG  and  LR  methods.   The  LG  method,  being  non-parametric, 
can  use  the  same  data. 

a.  Generate  N-  uniform  (0,1)  random  numbers  for 
component  one.   Denote  these  U--fU-2, »^1N 


b.   Let  P1  .  = 


Appendix.  E  shows 

0 


0  if  a  success  occurred  for  compo- 
nent one  on  trial  j 

1  if  component  one  failed  on  trial 
j,  0=1,2, Nx 


if  0<Uxj  <Exp(-Xi)  (3.M 

if  Exp(-Xi)  <U^  <1 


and     *_-|l     lfF^-0  (3-5) 

if  FXj  =  1    j=l,2 Nx 
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c.  For  the  LG  method,  compute 

(2NX  -3) 
Al  =   (2Nx-2)  (3-6) 

Nl 

Bi=^rr  (3.7) 

JJi 

and        P1  =  £  F-.  (3.8) 

1   j=l  1J 

d.  For  the  CLG  method,  compute  the  test  time  for 

component  one. 

Nl 
Tsum.  =  £  T-  .  (3.9) 

1   j=l   J 
Step  three j   Compute 

for  the  LG  method,  and 

for  the  CLG  method. 

Step  foun   The  component  test  times  for  the  MLR  method 
are  defined  differently  from  that  of  the  CLG  method.   The 
MLR  method  uses  only  accumulated  time  to  the  last  failure 
for  each  component;  if  no  failures  occur  this  is  zero. 
Thus,  compute  for  component  one 

T*  _  [lT*  if  F  >  0  (3.12) 

"   Tl"j=1TlJ 

where  T..  is  as  defined  on  page  20. 
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Step  fivei  Compute  the  number  of  trials  on  component 


two, 


N2  "  Nl  -  [*FJ 


Repeat  steps  two,  three,  and  four  for  component  two.   Then 
compute  N«3  =  N^  -  [KF^  +  F2)J  .   In  general,  the  sample  size 
for  the  ith  component  is 


Ni  =  Nl- 


i-1 
§  Z   P. 

3=1  0J 


(3.13) 


Step  six:  Continue  alternating  through  steps  two 
through  five  for  the  remainder  of  the  components. 
Step  seven*   Obtain 
K 


A       "■  A 

S  =  Z    T. 
1=1  1 

K 

z  =  z   z. 

i=l  1 

Var(S)  =  Z   (T./N. ) 
i=l   x  X 

Var(Z)  =  £  (Z./N. ) 
i=l   x  x 


A      AO   .A    A 

r  =  S2/Var(S) 

A      Ao     /N    A 

L  =  zVvar(Z) 

and  the  total  number  of  replica  failures 

K 
FT  =  Z    F. 
i=l  1 


(3.1*) 

(3.15) 
(3.16) 

(3.17) 

(3.18) 
(3.19) 

(3.20) 
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Step  eight «   To  preclude  non-integer  degrees  of  freedom, 
denote 

[2r]  =  raax<2,  smallest  integer  >  2r|  (3.21) 

[2I1]  =  max  Iz9   smallest  integer  >  2l|  (3.22) 

Step  ninet   For  the  MLR  procedure,  compute 

(3.23) 


U=  Imin  Ni 

if  FT  =  0 

(rain  T?      otherwise,  i=l 

and 

h   = 

r greatest  index  such  that 

< 

li  * 

Z    T.  .  <  U     if  F.  >  0 

0=1  1J         x 

L    0            if  F.  =  0 

then 

obtain 

I  =  max  < 

[,,»,,l 

(3.24) 


(3.25) 

The  zero  failure  portion  of  the  U  computation  sets  U  to 
the  observed  number  of  "system"  successes  (see  Appendix  D), 
Step  teni  Compute  the  replica  one  LCL's  for  the  three 
procedures.   Define  RD,  RT,  and  RL  for  discrimination  as 
below 

a.  LG  method 

*S,L(a)   =-  "  '  ExP  {y22f]  ;  ~  >  ^.26) 

LAl-a,[2rJ 

b.  CLG  method 

«S.L(a)-RT=^{g^J^  (3.27) 


c.      MLR  method  „       2 

1  zLx 


ZL 


RS,L(a)    S  RL  =  Exp  <      '  gfr"       >  (3. 28) 
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Step  eleveni   Replicate  steps  two  through  ten  500  times 
to  obtain 

RD1$    RD2, ,RD, 


RT^t  RT^t 

RL* i  RLp , 
FTlf  FT2, 


,RT 


,RL 


,FT 


500 
500 

500 

500 


Step  twelvei   Order  the  LCL's  in  step  eleven. 


RD 


RT 


(1) 
(1) 


RL, 


,  RD 
,  RT 
,  RL, 


(2) 

(2) 


,RD 
,RT 


(500) 

(500) 


,RL, 


'(1)'  "(2) '""(500) 

Step  thirteent   Next,  compute  A-    for  the  three  proce- 


dures. 


RD 


RT 


RL 


(500(l-a)) 
(500(l-a)) 


(500(l-a)) 


and  the  average  number  of  failures  per  replica 

/s    ,   500 
1   500  jti   o 

Each  procedure's  sample  variance  is  computed  by 


(3.29) 


s2= 


1     500  r  A 


^9  .1=1 


l  2 


(RS,L(a))j-(RS,L(a)) 


(3.30) 


where  R 


S,L(a) 


denotes  the  average  LCL  over  the  500  replicas. 


Now  each  procedure's  accuracy  can  be  determined  by  comparing 
A1    to  true  system  reliability  R  ,  and  relative  dispersion 
by  comparing  s. 
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Reference  1,  the  original  LG  method  paper,  used  the 

quantity 

K 
TT  =  Z    N.Q.  (3.3D 

i=l  1  1 

as  a  measure  of  accuracy  and  the  amount  of  testing  necessary 

to  assure  sufficient  accuracy  of  the  LG  procedure.   As  long 

as  no  component  sample  size  is  below  ten,  Table  I  shows 

recommended  TT  for  the  LG  method  (Reproduced  from  Ref.  1, 

p.  19). 

TABLE  I 
Recommended  TT  for  the  Log-Gamma  Method 

100(l-a)#  Minimum  TT      Reasonable  TT 

80  3  ^ 

90  8  10 

95  15  20 

The  simulation  computes  equation  (3.29)  for  comparison 
with  the  above  Table. 
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IV.      THE  INITIAL  SIMULATION 

A.  CASE  DESCRIPTION 

The  initial  cases  analyzed  had  true  system  reliabilities 
ranging  from  near  .70  upwards  and  were  composed  of  fifteen 
or  forty  components.   The  average  number  of  failures  per 
replica,  TT,  ranged  up  to  near  15.   The  first  simulation 

A 

used  the  formulas  for  Rs  T/a)  on  page  28.   The  results  are 
listed  in  Table  III.   Two  cases  were  also  ran  with  a  Weibull 
failure  distribution,  vice  exponential,  to  test  the  CLG  and 
MLR  procedures  sensitivity  to  the  exponential  assumption. 
Appendix  E  develops  the  PIT  method  for  generating  exponential 
and  Weibull  failure  data.   Table  IV  lists  Weibull  results. 

B.  RESULTS  AND  ANALYSIS 

The  LG  method  conformed  to  Reference  1  assertions  in 
that  performance  improved  with  increasing  TT,  although 
Ref.  1  did  not  generate  component  sample  sizes  in  the  same 
manner  as  this  study.   This  should,  however,  have  no  effect 
on  the  results. 

Small  TT,  such  as  in  cases  one  and  three,  resulted  in 
conservative  LG  and  CLG  LCL's  (ie.,  A1   <R_). 

1  ™ Q    S 
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TABLE  II 
NOMENCLATURE  FOR  SIMULATION  RESULTS  TABLES 


N- 


K 


R. 

l 


mm 


max 
TT 


1-a 


LG 
CLG 
MLR 
RLG 


Sample  size  of  1st  component;  analogous  to  the 
number  of  systems  tested 

Number  of  series  connected  components 

True  reliability  of  the  ith  component 

True  independent  series  system  reliability 

K 
Rs=  TT  R. 
s  i=l  1 

Minimum  number  of  failures  in  one  replica 

Maximum  number  of  failures  in  one  replica 

Average  number  of  failures  per  replica;  approx- 
imation for      K 

TT=  I  N.Q. 


i=l 


1  1 


Sample  standard  deviation  of  Rs  -rfa) 

The  500(l-a)th  order  statistic  of  Rg  L/  %  for 
each  of  the  three  methods  ■  *a' 

The  Log-Gamma  method 

The  Continuous  Log-Gamma  method 

The  Modified  Lieberman-Ross  method 

The  Randomized  Log-Gamma  method  (modification 
three  only) 


For  example,  the  case  one  sample  size  for  the  first 
component  was  N..  =  20,  and  the  series  system  modeled  had 
K  = 15  components  each  with  true  reliability  R.  =  .99.   True 
system  reliability  Rg=.860.   There  were  as  few  as  zero 
(min=0)  and  as  many  as  eight  (max  =  8)  component  failures 
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over  the  500  replicas  of  case  one,  with  the  average  number 
of  failures  per  replica  being  2.9  (TT=2.9)#   Comparing 
A1    to  R_  for  accuracy,  the  LG  80$  procedure  had  A-   =.799 
and  s=.07^,  whereas  the  MLR  had  Ai  ~  =  »851  and  s=.255. 
Thus,  in  case  one  both  procedures  were  conservative,  but 
the  MLR  was  more  accurate.   However,  the  LG  procedure  had 
^less  than  one-third  the  dispersion  of  the  MLR  procedure. 

Increased  testing,  as  in  cases  two  and  four,  not  only 
improved  their  accuracy  but  showed  smaller  sample  standard 
deviation.   The  same  comparison  holds  for  case  five  with 
case  six,  and  case  seven  with  case  eight.   Also  note  the 
closeness  of  both  A..    and  s  for  the  LG  and  CLG  methods. 
This  basically  says  that  even  though  more  assumptions  are 
required  and  information  is  needed  for  the  CLG  method  than 
the  LG  method,  it  yields  no  better  results. 

Case  three  of  Ref .  1  is  essentially  case  five  of  Table 
III;  case  five  is  essentially  case  six,  and  case  eleven  is 
essentially  case  two  (note  that  Ref.  1  miscomputed  TT  in 
cases  three  and  five).   The  accuracy  achieved  by  case  five 
was  not  as  high  as  that  of  case  three,  but  the  sample 
standard  deviation  was  comparable.   In  the  other  two  compar- 
able cases,  both  the  accuracy  and  dispersion  match  closely. 

The  MLR  procedure  is  the  most  accurate  of  the  three, 
both  in  low  and  high  TT  cases.   The  sample  standard  devia- 
tion, however,  is  three  to  five  times  that  of  the  LG  method. 
The  most  disturbing  thing  about  the  MLR  method  is  that  even 
with  increased  testing  (TT),  s  is  still  high. 
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Reference  6  shows  that  the  LR  method  is  expected  to 
have  high  dispersion  above  about  ten  observed  failures 
(Figure  1,  p.  22).   The  MLR  method,  even  in  the  cases  with 
ten  or  more  failures,  still  has  much  higher  dispersion 
than  the  LG  and  CLG  procedures.   Reference  6  attempted  to 
improve  the  LR  method  by  reduction  of  data  loss.   By- 
ordering  the  failure  times  in  increasing  order,  maximum  data 
usage  and  chi  square  degrees  of  freedom  were  attained.   The 
resultant  LCL's  were  found  to  be  biased  in  an  unpredictable 
direction  (based  on  a  single  parameter)  and  were  even  more 
widely  dispersed.   It  was  therefore  proposed  that  all  possi- 
ble orderings  of  the  data  be  considered,  and  research  is 
currently  being  conducted  in  that  area.   Thus  this  study 
pursued  it  no  further. 

The  two  Weibull  cases  showed  that  the  CLG  and  MLR  methods 
were  slightly  sensitive  to  the  exponential  assumption. 
Since  T^>  exponential  (X)  implies  T1' *  ^  Weibull  (P,X)  (see 
Appendix  E),  then  for  £  =  .5  and  T<1  mission  unit,  the  gen- 
erated Weibull  failure  time  is  sooner  than  its  exponential 
counterpart.   Likewise,  for  3=3.0,  the  Weibull  time  is 
later.   In  fact,  case  one  with  £=.5  gave  slightly  lower 
A1-a  for  both  methods  (excepting  the  80#  MLR  LCL).   With 
3=3. Oi  both  cases  gave  slightly  higher  A-    (again,  with 
the  same  exception  as  above). 
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V.   MODIFICATIONS  OF  THE  METHODS 

A.   MODIFICATION  ONEi   EXACT  DEGREES  OF  FREEDOM  AND  ADJUST- 
MENT FOR  ZERO  FAILURES 

1.  Description 

The  original  LG  method  employed  only  integer  de- 
grees of  freedom;  the  initial  results  of  Chapter  IV  adhered 
to  this  convention  for  all  three  methods.   The  accessibility 
of  computers  today  makes  chi  square  values  with  non-integer 
degrees  of  freedom  readily  available.   Rounding  up  degrees 
of  freedom  by  usage  of  the  "smallest  integer  greater  than 
or  equal  to"  function  can  also  cause  monotonicity  problems 

A 

in  Rs  L(a).  Consider  LG  80%  LCL's  in  the  case  where  N1=20, 
and  only  one  failure  occurs.   Then 

(5.D 


then 


A 

s  = 

*=15A 
i-1      * 

a 

.05 

A 

r  = 

A2 

s\ 

15  Tj 
1=1  "i 

= 

(.05)2 

(.05/20) 

2r 

=  2 

[2*1 

=  2 

(5.2) 


=  1 


thuS'    *S,L(a)  ■  Exp  J  -^Mi-1  (5.3) 

1  Xl-a.  [2gj 
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*S,L(.2)  -^l^^1     =  ' 

I  I. 8,2  J 


799 


Now,  take  the  exact  same  case  and  outcome,  except  that  in- 
stead of  one  failure  in  one  component,  two  failures  occur 
in  the  same  component.   Then, 
S  =  .103 

£  _   (.103)*   .  2  0„ 

r  ~   (.103/20)   "  ^*U3jJ 

2r  =  1+.105 

ttf]  -  5 
It  follows  that, 

I  A. 8,5   J 
The  above  LCL  is  higher  even  though  one  more  failure  oc- 
curred, due  to  rounding  up  degrees  of  freedom  2r. 

Another  improvement  felt  necessary  was  an  adjustment 
for  the  event  of  no  failures  for  the  LG  method.  The  initial 
procedure  here  gives 

A 

S  =  0 

A 

and    Rc  r,    v  =1.00 

Therefore,  the  following  was  incorporated i   Suppose 
there  are  no  failures  in  one  replica  with  N-  initial  compo- 
nent trials.   Then  set  the  number  of  failures  on  the  first 
component  as  P-  =  §  and  compute  2r  as  if  one  failure  had  oc- 
curred  (this  effectively  constrains  2r>2).   This  ad  hoc  and 
simplistic  adjustment  will  produce  zero-failure  LCL's  as  a 
function  of  N-  ,  and  satisfies  monotonicity  requirements. 
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The  simulation  was  again  run  with  the  adjustments 
above  for  certain  test  cases.   The  results  are  listed  in 
Table  VI. 

2.   Observations  and  Analysis 

Due  to  the  fact  that  the  MLR  method  never  assumes 
non-integer  degrees  of  freedom,  it  was  unaffected  by  this 
modification.   Both  cases  tested  had  slightly  lower  A1 
and  sample  standard  deviation,  s  for  the  LG  and  CLG  methods. 
The  smaller  s  can  be  attributed  to  less  discreteness  in 
Rs  t/^)*   The  lower  A-    is  caused  by  the  fact  that  7«    2 
increases  faster  than  2n.   By  rounding  up  the  degrees  of 
freedom  2n  to  [2n],  the  initial  simulation  produced  slightly 
higher  LCL's  than  did  modification  one. 
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While  this  modification  slightly  decreased  disper- 
sion, it  did  not  improve  the  accuracy  of  the  LG  and  CLG 
methods  (and  had  no  effect  on  the  MLR  method).   The  only 
real  gain  was  to  solve  an  infrequent  monotonicity  problem. 
If  only  integer  degrees  of  freedom  are  available,  it  is 
recommended  that  a  more  refined  scheme  of  rounding  non- 
integer  outcomes  be  devised.   For  instance,  in  the  earlier 
example,  2r  =  ^,105  should  be  rounded  down  to  **■  vice  up  to 
5.   The  LG  LCL  becomes  ,779»  which  is  lower  than  the  one- 
failure  .799  outcome,  but  still  higher  than  the  .738  three 
failure  outcome  (see  Table  VII), 

Being  that  the  CLG  method  performs  no  better  than 
the  LG  method,  but  requires  more  assumptions  and  informa- 
tion, no  further  effort  was  expended  on  it.   All  subsequent 
modifications  are  directed  towards  improving  the  accuracy 
of  the  LG  method  while  maintaining  small  dispersion. 

B.   MODIFICATION  TWO 

1.   An  Accuracy  Improvement .  and  an  Adjustment  for  the 
Degrees  of  Freedom  in  the  90%  Lower  Confidence 
Limit  Procedure 

The  primary  weakness  of  the  LG  method  is  its  poor 
performance  when  few  failures  occur.   More  testing,  and 
thereby  more  failures,  results  in  a  more  accurate  A- 
Table  VII  lists  and  plots  possible  LG  LCL's  for  zero  through 
ten  failures  when  N-  =  20.   Note  the  gaps  caused  by  discrete- 
ness up  to  one  failure.   Also  note  that  the  90%   LCL  for  two 
and  three  failures  is  higher  than  that  for  one  failure. 
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This  non-monotonicity  is  caused  by  the  sharp  drop-off  in 
ll   =A.  g  at  low  degrees  of  freedom.   As  an  adjustment, 
2r  for  9Cfo   LG  LCL's  was  constrained  to  be  at  least  2.5? 
the  minimum  2r  for  QOfo   LCL's  remains  2.0.   The  results  can 
be  seen  in  Table  VIII. 

Consider  the  classical  binomial  component  LCL  pro- 
cedure on  the  probability  of  mission  success  p.   If  p  is 
estimated  by  p  =  X/N  where  X  is  the  observed  number  of 
successes  in  N  trials,  then  a  100(l-a)$  LCL  on  p,  denoted 
pL/  x ,  is  the  solution  for  p  in  the  equation 

£  (*?)pj(l  -  p)N"j  =  a  (5.M 

j=x  J 

Under  the  simulation  of  Chapter  III,  if  N^  is  the  component 
one  sample  size  and  no  failures  occur  in  a  replica,  it  can 
be  equivalently  stated  that  N.  "systems"  were  tested  with- 
out failure.   Likewise,  one  component  failure  implies  ex- 
actly one  system  failure.   However,  when  two  or  more 
different  types  of  components  fail,  it  cannot  be  ascertained 
how  many  system  failures  occurred.   Figure  3  illustrates 
this  for  the  two-failure  case. 

Figure  3 
Component  Failures  Versus  System  Failures 
Component    12 K  12 K 

N-  systems  x  x -      N^  systems   x   -.....- 

tested  with  „  tested  with 

one  system  .     two  system 

failure  I  failures  ?   ! 
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Treating  a  "system"  as  a  component,  equation  (5.*0 

A 

can  be  used  to  calculate  Rs  T(a\  when  zero  or  one  failures 
occur. 

a.  Zero  failures t 

For  X=N  successes,  p^  *    \  =  <x   *•   Modifica- 
tion two  revised  this  upwards  to 

«S.L(a)=  NlJS+.2U-Nl^>  (5.5) 

b.  One  failure i 

Equation  (5«^)  was  applied  directly  for  X=N^-1. 

A 

That  is,  Rs  L/  v  is  the  solution  for  p  in  the  equation 

I1     ("l)p3(l-p)Nl-J=  a  (5.6) 

N^Nl-^l-p)  +  pNl  =  a  (5.7) 

c.  Two  through  eight  failures: 
The  LG  method  was  adjusted  upwards  as  follows: 

RS,L(a)-* 


or 


(5.8) 


>fL(a)(Nl'ra)  +  RS.L(a)<Nl'PT-1) 

where  R„  x.(or^Nl»FT^  denotes  the  LG  LCL  computed  with  the 
observed  total  replica  failures  FT  when  the  original  sample 
size  is  N-. 

d.   More  than  eight  failures: 

The  original  LG  procedure  is  used  with  exact 
degrees  of  freedom.   The  results  are  in  Table  IX. 
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2.   Observations  and  Analysis 

Modification  two  did  improve  the  accuracy  of  the 
LG  method,  while  slightly  increasing  dispersion.   The  90?o 
procedure  was  noticeably  improved  by  the  degrees  of  free- 
dom constraint,  although  still  conservative.   There  is, 
however,  still  too  much  discreteness  in  values  of  R~  re„\ 
when  few  failures  occur.   Table  X  generated  at  NPS  by  APL 
subroutine  "Histlist"  (see  documentation),  illustrates  this 
for  case  five.  This  discreteness  usually  causes  the  proce- 
dure to  yield  more  than  the  target  1-a  confidence,  and  is 
a  problem  with  nearly  any  method  using  only  attributes  data. 

This  being  the  case,  the  next  logical  step  was  to 
fit  a  continuous  curve  to  the  procedure  by  randomization. 

C.   MODIFICATION  THREEi   RANDOMIZATION 

1.  Randomization  of  the  Log-Gamma  Method 

Many  LCL  procedures  which  use  only  attributes  data 
are  degraded  in  that  they  yield  conservative  bounds.   Be- 
cause only  a  finite  set  of  outcomes  can  be  observed  for  any 
test  plan,  then  only  a  finite  set  of  LCL's  can  be  realized. 
Thus,  Rs  rtn\    is  a  discrete  random  variable  which  ideally 
gives  the  LCL  closest  to  but  not  greater  than  the  "exact" 
LCL. 

The  1975  article  of  Barr  and  Jayachandran  [Ref.  7, 
p.  67-68J  developed  an  exact,  randomized  binomial  component 
LCL  procedure.   The  same  rationale  used  before  (see  Figure  3) 
allows  the  randomized  binomial  procedure  to  be  used  for 
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TABLE  X 
Case  5  Log-Gamma  80  Percent  LCL's  with  Modification  Two 


SERIAL  NUMBER 

ORDERED  DATA 

OCCURENCES 

PERCENT 

1 

.407610 

1 

.002 

2 

.444490 

1 

.002 

3 

,444960 

1 

.002 

4 

.471830 

1 

.002 

5 

.475840 

2 

.004 

7 

.477390 

3 

.006 

10 

.482700 

2 

.004 

12 

.484660 

1 

.002 

13 

.487430 

1 

.002 

14 

.527610 

1 

.002 

15 

.534450 

3 

.006 

18 

.538120 

10 

* 

.020 

28 

.538550 

1 

.002 

29 

.540650 

1 

.002 

30 

.541090 

1 

.002 

31 

.542420 

2 

.004 

33 

.542860 

1 

.002 

34 

.571020 

11 

* 

.022 

45 

.576210 

1 

.002 

46 

.577770 

7 

* 

.014 

53 

.578300 

2 

.004 

55 

.580530 

10 

* 

.020 

65 

.581070 

1 

.002 

66 

.583950 

1 

.002 

67 

.584260 

2 

.004 

69 

.584910 

2 

.004 

71 

.616160 

13 

«* 

.026 

84 

.620600 

5 

» 

.010 

89 

.622570 

14 

** 

.028 

103 

.623270 

1 

.002 

104 

.624390 

24 

**# 

.048 

128 

.625090 

2 

.004 

130 

.627950 

1 

.002 

131 

.628010 

1 

.002 

132 

.628080 

1 

.002 

133 

.662770 

23 

*** 

.045 

156 

.66638O 

1 

.002 

157 

.666490 

14 

** 

.028 

171 

.667840 

1 

.002 

172 

.668570 

16 

** 

.032 
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TABLE  X 
(continued) 


SERIAL  NUMBER 


ORDERED  DATA 


OCCURENCES   PERCENT 


188 
209 
210 
216 
218 

219 
220 

257 

279 
304 
310 
312 

359 

380 
401 
403 
442 

469 
490 


.669380 
.669530 
.670340 
.671090 
.672070 
.673220 
.710230 
.713320 
.714870 
.715380 
.716280 
.756600 
.758850 
.759200 
.761320 
.789380 
.791340 
.890140 
.938140 


21  *** 
1 

6  * 
2 
1 
1 

22  *** 


25 
6 
2 

47 

21  *** 

2i  *** 

2 

39 
27 
21  *** 
11  * 


**#•** 
»*•» 


.042 
.002 
.012 
.004 
.002 
.002 
.074 
.044 
.050 
.012 
.004 
.094 
.042 
.042 
.004 
.078 
.054 
.042 
.022 
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"system"  LCL*s  when  zero  or  one  failure  occurs.   Equations 
for  the  Randomized  Log-Gamma  method  (RLG)  are  derived  in 
Appendix  F.  An  example  is  given  in  Appendix  G, 
a.   Randomized  Log-Gamma  Procedure 

(1)  If  zero  failures  occur,  generate  a  uniform 
(0,1)  random  number  Y.   Then 

r,     „        ,1/Ni 
RS,L(a)  ^(-rrr)  if  Y<l-a 

|  (5.9) 

1      l.o        if  y>l  -a 

(2)  When  one  failure  is  observed,  generate  a 

A 

uniform  (0,1)  random  number  Y.   Then  R~  r(n)    is  "the  solu- 
tion for  p  in  the  equation 

(l-Y)N1pNl"1(l  -p)  *  pNl  =  a    if  Y<1  -a       (5.10) 

This  solution  can  be  approximated  by 

«S.L(a)=  °1/Nl  (5.1D 

for  Y>l-a  (see  Appendix  F). 

(3)  Two  through  four  failures  inclusive i 
Generate  a  uniform  (0,1)  random  number  Y. 

for  each  component  that  had  at  least  one  failure,  i=l,2,... 
. ,.,K.   Then  use  the  LG  method  with  F.  =  F.  -  Y.  instead  of 
F..   Thus,  the  RLG  formulas  become 

(5.12) 
(5.13) 


Ai " 

B.    = 

l 

2Ni-3 

2Ni-  2 
Ni 

N.  -  1 
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A         F.  -  Y.      B.   F.  -  Y.   2 

S  =  2  T.  (5.15) 

i=l  X 

r  =  -^Sj- (5.16) 

n  — — 

i=i  Ni 

and       8S,L(tt)  '*" {'J***   >|  (5,17) 

The  only  differences  between  the  original  LG  formulas  and 
those  above  is  the  computation  of  T.  in  equation  (5«1*0» 
and  usage  of  exact  degrees  of  freedom, 
(*0   Five  or  more  failures i 

Use  the  non-randomized  LG  method  v/ith  ex- 
act degrees  of  freedom.   That  is,  use  the  formulas  in  (3) 

A 

above  except  use  F.  vice  F.  -  Y,  in  the  computation  of  T.  , 
2.   Modification  Three  Cases 

The  number  of  cases  simulated  under  modification 
three  was  expanded  greatly.   Cases  one  through  twelve  have 
an  N-  of  either  20  or  50 t  and  cover  the  range  of  pertinent 
system  reliability  R  .   All  twelve  cases  were  first  ran 
with  the  number  of  components  K=15t  and  then  reran  with 
K=^0,   Cases  with  equal  component  reliabilities  were  also 
ran  with  K=4.   The  system  sample  size  was  reduced  to  ten, 
and  the  applicable  twelve  cases  ran  again,  with  K  =  15.  ^0, 
and  k.      Modification  three  results  are  listed  in  Table  XI 
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for  K  =  15,  Table  XII  for  K  =  ^0,  and  Table  XIII  for  K  =  k. 
Table  XIV  lists  results  of  cases  from  Ref.  1,  which  had 
highly-varied  component  sample  sizes. 

3.  Results,  Analysis ,  and  Conclusions 

All  three  method  results  were  tabled  for  comparison 
under  modification  three,  although  randomization  of  the  LG 
method  was  the  only  change. 

The  accuracy  of  the  RLG  was  comparable  to  that  of 
the  MLR,  while  having  much  lower  sample  standard  deviations. 
Both  the  RLG  and  CLG  methods  had  dispersion  inversely  pro- 
portional to  sample  size,  while  the  MLR  continued  to  con- 
sistantly  have  high  dispersion  regardless  of  the  circumstances. 

The  most  significant  improvement  in  the  RLG  was  its 
performance  with  few  failures  and  less  testing.   Especially 
in  the  K  =  *+  and  K  =  15  cases  with  small  TT,  the  RLG  was  near 
exact  while  the  CLG  sometimes  gave  A-    of  1.00  (meaning 
at  least  the  upper  (100)c$  of  the  simulated  distribution 
was  LCL's  of  1.00).   The  MLR  procedure  was  inaccurate  for 
very  high  reliability  systems,  such  as  case  11  with  K  =  15» 
due  to  the  upper  limit  of  its  possible  LCL  values.   In 
case  11,  with  N-=  20,  the  maximum  MLR  LCL  is  .923  with  zero 
failures  (see  Appendix  D),  whereas  true  system  reliability 
is  .956.  As  in  the  earlier  LG  results,  the  90#  RLG  procedure 
was  usually  less  accurate,  less  stable  and  slightly  more 
dispersed.   The  presence  of  one  component  with  dissimilar 
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reliability,  like  case  seven  with  K  =  15  seemed  to  degrade 
accuracy  somewhat.  Additional  testing,  however,  as  in  case 
eight,  dampens  this  out. 

Cases  one  and  two  of  the  original  LG  paper  [Ref.  lj 
were  also  simulated  with  modification  three  to  check  sensi- 
tivity to  mixed  sample  sizes  (see  Table  XIV).   Note  that 
randomization  was  rarely  necessary  in  case  two  (min=2), 
and  never  in  case  one  (min  =  5).  The  accuracy  of  all  three 
methods  was  high  due  to  the  large  amount  of  testing.   Note 
the  small  sample  size  of  the  twelth  component  in  case  one. 
This  seemingly  had  little  effect  on  the  RLG  method's  accura- 
cy, although  s  is  suspiciously  large  when  compared  to  case 
two.  When  R12  was  se"k  "to  »85i  the  effect  on  the  RLG   became 
clearer.  When  a  component  twelve  failure  occurred,  its 

A  A  A 

contribution  to  S  and  r  so  dominates  that  Rs  r(„\    is  nearly 
halved  from  what  it  would  have  been  otherwise. 

.  A 

Figures  4  and  5  give  histograms  for  R~  rea)    °f   "the 
RLG  procedure  generated  under  cases  one  and  two  respectively. 
3oth  have  skewness  and  kurtosis  roughly  comparable  to  a  nor- 
mal distribution,  and  both  have  medians  near-equal  to  their 
medians  (symmetric).  Figure  5  (case  two  with  N<  =  50)  has 

A 

a  lower  maximum  Rs  Tfa\   and  a  higher  minimum  than  Figure  k 
(case  one  with  N-S20),  reflecting  the  decreased  dispersion 
of  the  RLG  procedure  with  increased  testing. 
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APPENDIX  A 


APPROXIMATION  OF  S  BY  A  TAYLOR  SERIES 
The  Taylor  series  approximation  of  f(x)  about  x  =  a 
can  be  stated  asi 


f(x)  =  f(a)+f'(a)(x-a)  +    fW(*H*-a)      +  . . .  + 


21 


fi(a)(x>a)i 

•  ■  •  ~  «|  ^      •  •  • 

1  • 


f(a)  =0 
f (x) =- 

f"(x)  = 
fH,(x)  = 


1-Q. 


d-Qir 

(1-Q,)3    ' 


f- (a)  =  -1 

f"(a)  = 1 

fM,(a)  =  -2 


(A.l) 


Here,    f(x)=-ln(x),   where  x=(l-Q^).      Let  a  =  l. 
Then  (x  -  a)  =  -Q. 


Equation  (A.l)   becomesi 


,\3 


fi^oM-iK-Q.)^1''^     +  (-2?j-qi?%,,. 


*l*l 


=  Qi*-f+T" 


Q 


oo 


3 


£7 

K 


K  K       «*     Q.J 

Thus,      S   =     E   -ln(l  -Q    )    =     L       L     -f 
i=l  x  i=l    j=l     J 

Dropping  terms  of  order  three  and  higher, 


K 
1=1 


Qi*lf 


(A. 2) 

(A. 3) 


(A. *) 
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APPENDIX  B 


AN  UNBIASED  ESTIMATOR  FOR  Ti 

Q? 
Let  T.  =  Q.  +  -x- .  An  unbiased  estimator  T.  is  desired 


for  T. ,  which  is  of  the  form 


Ti  =  AiQi+  2Qi  (B'^ 


A      F« 

where  Q.  =  rp  .   The  number  of  failures  of  ith  component  P. 
is  a  binomial  (N  =  N.,  p  =  Q.)  random  variable  with  mean  N.Q. 
and  variance  N.Q.(1-Q.).  Thus, 

E(V  =  FT  E(Fi}  =  Qi  (3'2) 

Var(Q.)  =^Var(F.  )  =  ~-±s ^-  (B.3) 

1    NT      1       ni 

E(Q2)  =  VarfQ^  ♦  (EC^))2  (B.4) 

Qi(1-Qi)     2 

♦  Q7 


N,       "i 


Qi ;  Qf  +  wjQi 
Ni 


Substituting 


E^)  =  A-EfQ^  +  -^E(Q2) 

B.  B.  Q? 

*   (Ai  +  2TT)Qi  +  (Bi-N7^  (B^} 


That  T.  is  unbiased  implies 

E(TL)    =   Ti  =  Qi  ♦  -f  (3.6) 


Q? 
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Equating  coefficients  with  equation  (B.5) 

B.  -  Tp  =  1  (B.8) 

1   «i 

Solving  the  above  two  equations  simultaneously  gives  the 

desired  expressions  for  A.  and  B. 

2N.  -  3 
Ai  *     2N*  -  2  (3'9) 

Bi  "   N.-l  (3-10) 
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APPENDIX  C 
DERIVATION  OF  THE  ACTUAL  VARIANCE  OF  T. 

A  1 

K  T* 

AND  COMPARISON  WITH  Z   -«i 

Ti 
Reference  1  used  7-  as  a  variance  estimate  for  T. . 

Then  for  the  method  of  moments  gamma  fit, 

K     A  K  T. 

Var(S)  =  LVar(T,)«   I  -1  (C.l) 

i=l     1    i=l  hi 

The  following  is  a  derivation  of  the  actual  variance 

A. 

of  T. ,  and  then  a  comparison  with  the  above  estimator. 

Since  T.    =  A.Q.   +  -^QT  (C.2) 

B7 

then  Var(T.  )  =  A?Var(Q.  )  +  A.B.C0V(Q.  f3f )  +  nrfvar(Q?)        (C.3) 
11  111  11*+  1 

F. 

where  Q.  = 77*  •  The  total  number  of  failures  on  the  ith 
1  r^ 

component  F.f  is  a  binomial  (N  =  N.,  p  =  Q^)  random  variable 

Then      A     - 

E(Qi)  =  j^-ECF^  =  Qi  (C.4) 

a      1  Q.  (1  -  Q. ) 

Var(Q.)  =  ~  Var(F.)  =  1  x  (C.5) 

1    NT      1  j  1 

B(Q*)  =  Var(Qi)  ♦  (E^))2 

Qi"Qi     2 
=  V     +Qi  (C.6) 


and    C0V(QifQ2)  =  E(Q^)  -  eCQ-^ECQ2)  (C?) 
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To  solve  equation  (C.7)t  E(Q?)  =  -tE[p?)  must  be  solved. 


N? 


Model  In  =  J  1 
0 

Ni 
and  let  F,  =  I  I 

m=l  m 

Ni 
Then  Ft5  =  Z     I 
\m=l  m 


if  the  mth  test  fails 

if  the  nr"  test  does  not  fail 


L  Z  Z     I  I  I 

jkl  xj  Xk  il 


(C.8) 


(C9) 


and 


E(?i)  =  j=k=l  S(Ij)  *  ZL  E^j)E(Ik)  * 

(all  three  equal)   (two  the  same  and 

one  distinct) 

=  If  E(I  jWyid!)  (CIO) 

(all  three  distinct) 
=  NiQi+  3Ni(Ni-  1)Q?  +  Ni(Ni-l)(Ni-  2)Q^ 


Th 


is  implies  E(Q?)  =  4r  E(F?) 

1    Nf    x 


N? 
l  u 


Qi  +  3(Ni-l)Q^  ♦  (Ni-l)(Ni-2)Q^ 


Now,  using  equation  (C.7)» 


A   A 


COV(QitQ^)  =  -JH  1  +  (2Ni-3)Qi-2(Ni 


N,  - 1)Q?  > 


Ni 


(C.ll) 


All  that  remains  unknown  in  equation  (C.3)  is  Var(Q.). 


2^2 


Var(Qj)  =  E(QJ)  -  (E(QJ)) 


=  ^^)-{^*«?12 


(C.12) 
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Using  the  same  model  as  before, 

e<fi>  -j*iiL*  ?£"»?>♦  jk*»i>«v 

(all  indexes  (indexes  equal  (three  indexes  the 

equal)     in  pairs)     same  and  one  distinct) 

+  ^iE(I*)E(VE(Ii> 


(two  indexes  the  same  and  two  distinct) 

♦  j  k  1  mn  E<V  E<V  E<V  E<W 

(all  four  indexes  distinct) 


(C.13) 


=  N-Q^  3Ni(Ni-l)Q?>^Ni(Ni-l)Q^+6Ni(Ni-  l)(Mi-  2)Q? 


+  Ni(Ni-l)(Ni-2)(Ni-3)Qj 


Equation  (C.13)  is  used  to  find 


E(QT)  =  4r 
1    NJ 


Q^  7(Ni-l)Q|+  6(Ni-  1)  (Ni-2)Q? 


+  (Ni-l)(Ni-2)(Ni-3)Qi 


(C14) 


Substituting  equation  (C.l^)  into  equation  (C.12), 


Var(Q?) 


-|J  1+  (6Ni-7)Qi>^(Ni-l)(Ni-3)Qf 


-  2(Ni-l)(2Ni-3)Q|  > 


(C.15) 


The  final  result  can  now  be  obtained  by  substituting  equa- 
tions (C.15),  (C.ll),  and  (C.5)  into  equation  (C.3),  yielding 
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A?  Q.  r 

Var(Ti)  =rT(Qi-Qi)^AiBi"2  1+  (2Ni-3)Qi-2(Ni-l)Q^ 

i  Ni  L 


^^1+(6Ni.7)Q.+ 


^(Ni-l)(Ni-3) 


-  2(Ni-l)(2Ni-3)Q^ 


(C.16) 


The  cumbersome  expression  above  can  be  greatly  simplified 


by  dropping  terms  with  divisors  of  N?  and  higher,  yielding 

(C.17) 


VarCl^)  m  n±  ]  (1 -Qi)(Ai+BiQi)c 


Then  VarC^)  =^  ';  (1  -Qi)(Ai+BiQi)2  J  where  Q.  =  ^  (C.18) 

A  comparison  was  made  between  Var(T. )  as  given  by  equation 
(C.18),  and  that  used  by  Ref.  1.   The  results  are  listed 
for  N-  = 10,  20,  and  50  in  Table  XV.   The  simplistic  esti- 

A 

K  T. 
mator  Z  tt-     turns  out  to  be  an  excellent  approximation 


=lJi 

,A 


K 


for  Var(S)  =  Z   Var(T. ). 
i=l     X 
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TABLE  XV 

A 

Actual  Variance  of  T.  Compared  to  Estimate 
(One  Failure  Per  Component) 


y\     a   Kl:     y\     A 
FAILURES  Var(S)=  L  rf>         Var(S) 

i=l  i 


K  Q,     a 
=  Z   Al  -Q4 


1N. 

i=l  1 


i)(vBA)2 


8 


10 


1^=10 

.01000 

.01003 

20 

.00250 

.00250 

50 

.00040 

.00040 

Nx=10 

.02235 

.02242 

20 

.00527 

.00527 

50 

.00082 

.00082 

Nx=10 

. 03469 

.03480 

20 

.00804 

.00805 

50 

.00123 

.00123 

^=10 

.05032 

.05050 

20 

.01113 

.01113 

50 

.0016? 

.00167 

^=10 

.06594 

.06619 

20 

.01421 

.01422 

50 

.00210 

.00210 

^=10 

.08635 

.08672 

20 

.01767 

.01769 

50 

.00255 

.00255 

^=10 

.10676 

.10725 

20 

.02113 

.02115 

50 

.00301 

.00301 

^=10 

.13^ 

.13526 

20 

.02504 

.02506 

50 

.00348 

.00348 

Nx=10 

.16231 

.16327 

20 

.02895 

.02897 

50 

.00395 

.00395 

N1=10 

.20231 

.20377 

20 

.03339 

.03342 

50 

. 00445 

. 00445 
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APPENDIX  D 

DERIVATION  OF  THE  ZERO  FAILURE  CASE 
FOR  THE  MODIFIED  LIEBERMAN-ROSS  METHOD 

The  variables  U  and  I  are  undefined  when  no  failures 
occur.  Consider  type  III  censoring  in  which  N  components 
are  placed  on  simultaneous  test,  with  replacement,  until  a 
pre-selected  time  TQ  [Ref .  8,  p.  238J .   Type  III  censoring 
is  a  component  LCL  procedure,  and  not  a  system  LCL  procedure. 
Now,  consider  the  Modified  Lieberman-Ross  (MLR)  procedure 
where  N.  items  of  the  ith  component  have  been  tested  with  no 
failures,  i  =  l,2,...,K.   If  the  N.  are  identical  (as  is  the 
case  in  this  study  for  zero  failures),  then  the  above  is 
equivalent  to  testing  N.  "systems'*  with  no  failures  until 
TQ  =  1  "system"  mission. 

The  type  III  lOO(l-a)^  LCL  on  the  mission  probability  of 
success  p  of  a  component  is 

where  F  is  the  observed  number  of  failures,  N  is  the  number 
of  components  on  simultaneous  test,  and  TQ  is  the  preselect- 
ed test  time.   Then  for  F  =  0,  2F+2  =  2  and 

2NT  =  2N.  •  1  system  mission  unit  =  2N, 

A  100(l-a)#  LCL  on  system  reliability  R  when  no  failures 

s 

/  ^2    \ 
occur  is 


RS,L(a)  ■  ExP' 
for  N.  equal,  i=l,2,...,K.   If  the  N.  are  not  equal,  the 
minimum  N.  should  be  used. 
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APPENDIX  E 

USE  OF  THE  PROBABILITY  INTEGRAL  TRANSFORM  (PIT)  IN 
GENERATING  EXPONENTIAL  AND  WEIBULL  FAILURE  DATA 

Assume  an  exponential  failure  process  for  the  ith  com- 
ponent with  rate  X.  per  mission  unit.   Then  the  reliability 
of  the  ith  component  for  completing  one  mission  unit  is» 

RjU)  =  Zxv(-\i   .1)  .  (F.l) 

Utilizing  the  PIT  method,  draw  a  uniform  (0,1)  random  num- 
ber, denoted  "UM,  and  form  the  equality t 

U  =  Exp (-\it)  (F.2) 

Solving  for  time-to-failure  t 

ln(U)  =  -X.t  (F.3) 

It  follows  that: 

i 
The  computer  program  uses  the  following  algorithmi 

1)  Generate  a  uniform  (0,1)  random  variable 

2)  If  U  =  Exp(->*it)  is  less  than  Exp(-fc.  '  1),  then  t>l 
mission  unit,  and  a  success  has  occurred.   Truncate  the 
time-on-test  for  that  component  trial  to  1. 

3)  Otherwise,  a  failure  has  occurred  at  t  =  — =— £-* — *— 

i 
The  simulation  was  also  ran  under  a  Weibull  failure 

process  for  sensitivity  analysis.   The  Weibull  (P,X)  densi- 
ty  function  is    ^(t)  =  gxt9"1  Expf-Vt6  )  (F.5) 

and  hazard  function 

h(t)  =  ext^"1  t>o,x>o,e>o       (f.6) 
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Using  the  PIT  method  as  before,  draw  a  uniform  (0,1) 
random  number  U  and  set 

U  =  F(t) 

=  Exp(-XitP)  (F.7) 

thus        T  =  C  1v(U)  )l/g  (F.8) 

i 

Comparing  equations  (F.*0  and  (F.8)  shows  that  if 

j  _  z — DA — i  is  an  exponential  (X.)  component  failure  time, 
Ai  x 

then  T1/^  is  Weibull  (?,  >>.).  Thus,  to  perform  the  Weibull 

sensitivity  analysis,  only  the  above  change  needs  to  be 

made  to  the  simulation  algorithm  (Chapter  III). 

Taking  the  derivative  of  the  Weibull  hazard  function 

with  respect  to  time 

d<h&»   =X.(S2-p)tS-2  (F.9) 

Therefore,  any  0<£<1  yields  a  decreasing  hazard  rate,  and 
any  0>1  gives  an  increasing  one.  Case  one  was  ran  with 
0  =  .5  and  3.C   Note  that  the  comparison  logic,  used  by 
the  simulation  algorithm  to  determine  if  a  failure  has 
occurred,  reduces  to  the  original  expression.   The  number 
of  failures  is  then  the  same  as  before.   The  Weibull  results 
are  shown  in  Table  IV. 
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APPENDIX  F 

DERIVATION  OF  THE  RANDOMIZED  LOG -GAMMA  METHOD 
The  technique  for  randomization  of  the  classical  bi- 
nomial model  is  a  direct  application  of  Barr  and  Jayachand- 
ran's  1975  article   LRe^»  7]  •   I*  can  be  applied  directly 
to  obtain  a  system  reliability  LCL  when  a  total  of  zero 
or  one  failure  occurs  among  all  component  tests,  because 
these  cases  translate  into  equivalent  system  failures  (see 
Figure  3.  p.  ^5). 

The  binomial  point  estimate  for  p  is  p  =  X/N,  where  X  is 
the  number  of  observed  successes  in  N  trials.   The  classi- 
cal binomial  100(l-a)#  LCL  for  p,  denoted  Pr/a)i  is  "the 
solution  for  p  in  the  equation 

2  d)pj(l-p)N-j  -O  (F.l) 

when  no  failures  occur,  or  X  =  N,  this  becomes 

PL(«)  =  al/N  <F-2> 

and  for  one  failure,  Pr/a)  is  "the  solution  for  p  in 

NpN"1(l  -p)  ♦  pN  =  a  (F.3) 

This  PT/a\  has  the  property  that  Pr|PT,(a)-^  £1~a 

Reference  7  develops  a  method  of  randomizing  discrete 
LCL  procedures  which  are  conservative,  and  illustrates  it 
for  the  binomial  case.   The  exact  randomized  100(1  -  &)$> 
binomial  LCL  for  p  is  developed  as  follows. 
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a.  The  number  of  observed  successes  X  is  a  binomial 
random  variable  with  probability  mass  function  3(x;N,p), 
Define  h(p)  as  the  smallest  integer  such  that  ' 

Pr(X>h(p))<a     x  0,1, N        (F.*0 

Thus,  h(p)  denotes  an  observed  value  of  X, 

b.  Define 

ap  =  Pr(X>h(p))  (F.5) 

and       y(p)  =F4  1  -  (a  -  ap)/B(h(p)  ;N,p)>        (F.6) 

where  F  is  the  "randomizing"  distribution  function  of  Y. 
Reference  7  shows  that  F  can  be  the  uniform  (0,1)  distribu- 
tion function  without  loss  of  generality.  Then  using 
equation  (F.5),  y(p)  can  be  simplified  to 

y(p)  =1  -  (a-Pr(X>h(p))/Pr(X=h(p))      (F.7) 
Finally,  define 

g(p)  =  h(p)  +  y(p)  (F.8) 

Then  the  exact  binomial  randomized  LCL  for  p,  L  (x+y) 

is  given  by  r> 


L   (x+y)  = 


\ 


g~   (x+y);  1  -  a<x+y  <N+l-a 

0        ;  x+y<l-a  (p>9) 

1.0         ;  x+y  >  N+l-a 


To   solve   for  L   (x+y),    form  the   equality 

g(p)    =  X*  Y   =  h(p)   +   y(p)  (F.10) 

Since  h(p)  is  an  observed  value  of  X,  this  reduces  to 

Y  =  y(p)  =1  -  (a-Pr(X>h(p)))/Pr(X  =  h(p))      (P.  11) 
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L  (x+y)  = 


< 


By  solving  for  p  and  applying  equation  (F.9) 

the  solution  for  p  in 

(1  -  Y)Pr(X=x)  +  Pr(X>x)  =  a     1-a  <  x+y  <  N+l-a 

0  x+y  <  1  -a 

(F.12) 
1.0  x+y>  N+l-a 

Thus,  for  no  failures,  or  X  =  N,  L  (x+y)  is  the  solution 
for  p  in 

(l-Y)pN  =  a  (F.13) 

(F.1M 


or 


PL(a) 


< 


(1  -Y 

1.0  y>  1  -  a 

when  X  =  N-1,  or  one  failure,  L  (x+y)  is  the  solution  for 
p  in 


or 


(1  -  Y)  Pr(X  =x)  +  Pr(X>x)  =  a 


(l-Y)NpN-1  (1-p)  +  pN  =  a 


(F.15) 


When  two  or  more  failures  occur,  a  component  LCL  pro- 
cedure  such  as  L  (x+  y)  cannot  be  used.   The  original  Log- 
Gamma  procedure  can,  however,  be  "randomized"  as  follows. 
Draw  a  uniform  (0,1)  random  number  for  each  type  of  compo- 
nent that  fails.   Denote  it  Y.  for  the  ith  component,  and 
compute  the  "randomized"  number  of  failures 


F  =  F.  -  Y. 
l    l 


(F.16) 


where  F.  is  the  observed  number  of  failures  on  the  ith 
component. 
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A 

R 


S,L(a)  = 


(F.l?) 


The  Randomized  Log-Gamma  procedure  (RLG)  was  developed 
by  trial  and  error  via  computer  simulation,  using  the  above 
adjustments  where  most  effective.   It  can  be  stated  as 

follOWSl 

Randomized  Log-Gamma  Method 

a.  Zero  failures  in  all  components i 

(T!r)1/Nl         y<i-a 

1.0  y>  1  -  a 

where  Y^-^  uniform   (0,1). 

b.  One  failure  among  all  components i 

A  the   solution  for  p  in 

RS,L(a)    =  N1    ,  - 

l/Ni  a 

The  use   of  a  '    x  as  an  approximation  to  R~  T(a\*    f°r  y>l-at 

is  reasonably  accurate  for  low  N-  and  very  accurate  for 

large  N^f  as  shown  below. 

TABLE  XVI 
Accuracy  of  the  Approximation  a  '  * 

Y=  .9 
a  =  .2 


(F.18) 


Actual  R 


S,L(a) 


N   = 


10 


20 


50 


.837 
.851 


.915 
.923 


.965 

.968 


c.   Two  through  four  component  failures i 

For  each  different  type  of  component  that  had  at 
least  one  failure,  draw  a  uniform  (0,1)  random  number. 
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Denote  it  Y.  for  the  ith  component,  and  compute 

Fi  =  Fi  "  Yi  (F'19) 

Compute  Log-Gamma  method  with  exact  degrees  of  freedom  and 

* 

F.  instead  of  the  observed  number  of  failures  F.  . 

d.   Five  or  more  failures i 

Use  the  Log-Gamma  method  with  exact  degrees  of 
freedom. 
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APPENDIX  G 

AN  EXAMPLE  OF  THE  RANDOMIZED  LOG-GAMMA  PROCEDURE 

Let  N-  =  20,  K  =  15f  and  a  =.2.   Suppose  that  the  replica 

has  no  failures.  Then  a  uniform  (0,1)  random  number  Y  is 

generated;  say  Y=  .5.   Then  since  Y  <  1  -  a, 

RS,L(.2)  =  (  1  1.5  )2  =  ,955 
as  opposed  to  the  classical  binomial  LCL  of  .923. 

Suppose  some  future  replica  had  one  failure  in  some 

A 

component,  and  Y=  .6  is  generated.   Then  R~  w  2)  1S  "t^9 
solution  for  p  in  the  equation 

20pl9(l-p)(l-  .6)  +  p20  =  .2 

A 

Therefore,  Rs  ,/  2)  =  .892.   The  classical  binomial  LCL  is 
.858. 

Now,  suppose  another  replica  had  two  failures  in  the 
5th  component  and  one  failure  in  the  15th  component,  and 

that  Y-=  .3  and  Y.^  =  .8  were  generated.   Thus,  P-  =  1.7  and 

# 
Fj-  =  .2.   Applying  the  LG  procedure,  N^  =  20,  N--  =  19 

A  -O     A  y\  /\ 

S    -      Z   T.  =  T-  +   T1  c    -    .0969 
i=l    x         5  i:> 

2  t    ™^x2 


r   =  4lt-  =      (t0^6?)        =   1   926 

r       iJtT         .0049  j-.v^o 


i=lNi 
2r  =  3.853 


X. 8, 3. 853  *  1#56 
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Then    Wa)=Hfi-h-78' 

A.8,3.853 
without  randomization,  the  LCL  would  have  been 

*S,L(.2)  "  -7k0 
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APPENDIX  H 

THE  COMPUTER  PROGRAM 

The  following  pages  list  the  computer  program  used  for 
the  simulations.   Flags  were  used  to  designate  the  portions 
of  the  program  to  be  executed,  depending  on  which  modifica- 
tions were  desired.   Proprietary  subroutines  [Ref,    9J  were 
utilized  for  inverse  chi  square  values  (MDCHI),  sorting 
the  approximate  distributions  of  Rs  T(r)»  (VSORTA),  gener- 
ation of  uniform  (0,1)  variates  (GGUB),  and  solving  for 
the  RLG  procedure  (ZREAL2).   The  APL  subroutines  HISTLIST 
and  HIST  were  used  in  Table  X  and  Figures  k   and  5  respec- 
tively [Ref.  lOj  .   The  plotting  subroutine  PLOTP  was  used 
in  Tables  VII  and  VIII  [Ref.  ll]  . 

The  program  was  written  in  the  FORTRAN  IV  language  for 
use  on  the  IBM-360  system  at  the  Naval  Postgraduate  School. 
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